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(57) Abstract: This invention relates generally to the art 
of computer graphics, and more specifically to the field of 
line sampling object scene information for the purpose of 
reconstrucitng an image of the object scene. In particu- 
lar, the inventions distributes a set of line samples across 
an image plane such that the distribution of the set of the 
line samples is non-regular. Additionally, the invention 
projects objects from an object scene onto an image plane 
and computes a view of the objects along each line sample 
in the set of line samples. Finally, the invention combines 
the view along each line sample in the set of line samples 
to form a view of the object scene. 
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SYSTEM AND METHOD OF LINE SAMPLING OBJECT SCENE INFORMATION 



This invention relates generally to the art of computer graphics, and more specifically 
to the field of line sampling object scene information for the purpose of constructing an 
image of an object scene. 

BACKGROUND OF THE INVENTION 

One form of computer graphics is to develop a sequence of video image frames of an 
object scene from object scene information. The sources of object scene information include 
computer databases and computer programs. The object scene information includes visual 
characteristics of an object scene, such as color and movement. Typically, one or more 
programs comprising a renderer process object scene information. 

More specifically, a video image frame includes a color value for each pixel of a 
monitor or display. Pixels are the smallest resolution element of the monitor or display. 
Processing object scene information corresponding to the general area of the pixel determines 
a color for a given pixel. 

Computer graphics systems typically develop each video image frame of computer 
animated video by point sampling the general location of a given pixel in an object scene. 
Essentially, a renderer processes object scene information to calculate a color value of an 
object scene at an infinitesimal point within the object scene. The renderer then averages 
color values of a set of point samples in the general area of a pixel to compute a color for the 
pixel. The distribution or positioning of the point samples is either regular or non-regular. 
The renderer generally accomplishes a regular distribution with a rigid, evenly spaced grid of 
point samples. Off-setting each point sample in an otherwise evenly spaced grid by a pseudo- 
randomly determined amount is an example of a non-regular distribution of point samples. 

Additionally, some computer graphics systems extend point sampling to simulate 
motion blur by distributing point samples within a period of time associated with a video 
image frame. 
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Furthermore, some computer graphics systems simulate depth of field by selecting, for 
a region of the image plane, a point through which to view an object scene on a simulated 
lens. The position of the point on the lens affects which objects in the object scene are 
projected onto the region of the image plane. 

5 Other computer graphics systems reconstruct a view of an object scene by area 

averaging. Unlike the point sampling described above, area averaging calculates an actual 
view of an object scene in the general area of a pixel. The systems then compute a color 
value for the pixel from the view. The process is substantially more time consuming than 
point sampling, however, because these systems calculate a view of an entire area (instead of 
10 a set of points within the area). 

Persons skilled in the art generally acknowledge that area averaging provides a more 
faithful reconstruction of a view of an object scene under certain circumstances than does 
point sampling. Point sampling, however, offers reduced computational complexity and 
allows for easy simulation of depth of field and motion blur. There is needed in the art, 
15 therefore, a means of reconstructing views of object scenes that provides the faithful image 
reconstruction of area averaging, but also provides reduced computational complexity and 
easy simulation of motion blur and depth of field. 



SUMMARY OF THE INVENTION 

20 In summary, the present invention is a system and method for line sampling object 

scene information for the purpose of reconstructing a view of the object scene. In particular, 
the invention distributes a set of line samples across an object scene such that the distribution 
of the set of line samples is non-regular. Additionally, the invention computes a view of the 
object scene along each line sample in the set of line samples. Finally, the invention 

25 combines the view along each line sample in the set of line samples to form a view of the 
object scene. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Additional objects and features of the invention will be more readily apparent from 
the following detailed description and appended claims when taken in conjunction with the 
drawings, in which: 

5 Figure 1 A is a block diagram of a computer system in accordance with an embodiment of the 
present invention. 

Figure IB illustrates the projection of an object onto an image plane in accordance with an 
embodiment of the present invention. 

Figure 1C illustrates processing steps for line sampling an object scene in accordance with an 
10 embodiment of the present invention. 

Figure 2A illustrates sampling based on a non-regular sequence of numbers and sampling 
based on a regular sequence of numbers. 

Figure 2B illustrates a two distributions of line samples, wherein the distribution on the right 
uses sub-pixels to further ensure a stratified distribution. 

15 Figure 3A illustrates an embodiment of the present invention in which an orientation and 

translation amount are selected in accordance with an embodiment of the present invention. 

Figure 3B illustrates processing steps in an embodiment of the present invention in which an 
orientation and translation amount are selected by reference to a non-regular sequence of 
numbers. 

20 Figure 3C illustrates a sub-pixel consistent with an embodiment of the present invention. 

Figure 3D illustrates an embodiment of the present invention in which an orientation and 
translation amount are selected in accordance with an embodiment of the present invention 
and a line sample is translated along a vector originating in the (1,0) translation origin. 

Figure 3E illustrates an embodiment of the present invention in which an orientation and 
25 translation amount are selected in accordance with an embodiment of the present invention 
and a line sample is translated along a vector originating in the (0,1) translation origin. 

-3 - 
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Figure 3F illustrates an embodiment of the present invention in which an orientation and 
translation amount are selected in accordance with an embodiment of the present invention 
and a line sample is translated along a vector originating in the (0,0) translation origin. 

Figure 3G illustrates an embodiment of the present invention in which an orientation and 
5 translation amount are selected in accordance with an embodiment of the present invention 
and a line sample is translated along a vector originating in the (1,1) translation origin. 

Figure 4A illustrates processing steps in an embodiment of the present invention in which an 
orientation and an area are selected by reference to a non-regular sequence of numbers. 

Figure 4B illustrates a general case for a line sample orientation and area selection, including 
10 analytic regions used to derive a translation amount from a selected area, where the selected 
orientation is in a range of 90 and 135-degrees in a preferred embodiment of the invention. 

Figure 4C illustrates regions of an area formed by a line sample and a sub-pixel that facilitate 
the derivation of an area-to-translation amount transformation in a preferred embodiment of 
the invention. 

15 Figure 4D illustrates a general case for a line sample orientation and area selection, including 
analytic regions used to derive a translation amount from a selected area, where the selected 
orientation is in a range of 0 and 45-degrees in a preferred embodiment of the invention. 

Figure 4E illustrates a general case for a line sample orientation and area selection, including 
analytic regions used to derive a translation amount from a selected area, where the selected 
20 orientation is in a range of 45 and 90-degrees in a preferred embodiment of the invention. 

Figure 4F illustrates a general case for a line sample orientation and area selection, including 
analytic regions used to derive a translation amount from a selected area, where the selected 
orientation is in a range of 135 and 180-degrees in a preferred embodiment of the invention. 

Figure 4G illustrates pixel area sampling rates resulting from an embodiment of the present 
25 invention. 

Figure 5A illustrates processing steps that ensure a stratified distribution of line samples in a 
preferred embodiment of the invention. 
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Figure 5B illustrates the selection of orientation and translation pairs wherein each orientation 
and translation pair is limited to a two-dimensional area such that a uniform distribution is 
achieved. 

Figure 5C illustrates the assignment of orientation and translation pairs to sub-pixels by 
5 reference to a non-regular sequence of numbers in an embodiment of the invention. 

Figure 6A illustrates processing steps that ensure a best candidate selection from a set of line 
samples in an embodiment of the invention. 

Figure 6B illustrates a selected line sample and a distributed set of line samples in adjacent 
sub-pixels in an embodiment of the invention. 

10 Figure 6C illustrates a line sample orientation comparison. 

Figure 6D illustrates a line sample orientation comparison. 

Figure 7 illustrates the simulation of depth of field in a preferred embodiment of the present 
invention. 

Figure 8A illustrates the projection of an object from an object scene onto an image plane in a 
15 preferred embodiment of the present invention. 

Figure 8B illustrate processing steps used to develop an analytic representation of an object 
scene along a line sample. 

Figure 8C illustrates the projection of an object from an object scene onto an image plane in a 
preferred embodiment of the present invention. 

20 Figure 8D illustrates the projection of an object from an object scene onto an image plane in a 
preferred embodiment of the present invention. 

Figure 8E illustrates the projection of an object from an object scene onto an image plane in a 
preferred embodiment of the present invention. 

Figure 9A illustrates processing steps that isolate unique sets of objects visible along and 
25 overlapped by a line sample sorted by distance from an image plane in a preferred 
embodiment of the present invention. 

-5 - 
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Figure 9B illustrates objects visible along and overlapped by a line sample sorted by distance 
from an image plane in a preferred embodiment of the present invention. 

Figure 9C illustrates objects visible along and overlapped by a line sample sorted by distance 
from an image plane after an intersection is processed in a preferred embodiment of the 
5 present invention. 

Figure 9D illustrates objects visible along and overlapped by a line sample sorted by distance 
from an image plane after a priority queue is adjusted in a preferred embodiment of the 
present invention. 

Figure 9E illustrates objects visible along and overlapped by a line sample sorted by distance 
10 from an image plane with a gap between the segments in a preferred embodiment of the 
present invention. 

Figure 9F illustrates objects visible along and overlapped by a line sample sorted by distance 
from an image plane with a gap between the segments corrected in a preferred embodiment of 
the present invention. 

15 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 A shows computer device 100. Computer device 100 is configured to execute 
the various embodiments of the present invention described below. Included in computer 
device 100 is central processing unit (CPU) 10, memory 20, and i/o devices 30. CPU 10 
20 executes instructions as directed by operating system 24 and other programs maintained in 
memory 20 and sends control signals to various hardware components included in computer 
device 100. 

Memory 20 also includes object scene data 21. Object scene data 21 is static 
information that describes one or more object scenes. An object scene is one of many that, 
25 for example, comprise the scenes of computer animated video. For example, object scene 
data 21 may describe the actions and physical or visual attributes of characters (i.e., objects) 
in an object scene. In particular, object scene data 21 specifies locations of objects within an 
object scene through the use of x, y and z coordinates. The x and y coordinates represent the 
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horizontal and vertical positions with respect to image plane 1 10 (of Figure IB). The z 
coordinate represents the distance of a point on an object from image plane 1 10. As 
illustrated in Figure IB, image plane 110 functions as a projection screen for object 120. 
Thus, image plane 1 10 facilitates a transformation of three-dimensional objects to a two- 
5 dimensional representation. Image plane 1 10 is analogous to a monitor or video display 
included in i/o devices 30. Positions on image plane 1 10 map to positions on a monitor or 
video display. Thus, references to pixels on image plane 1 10 are effectively references to 
pixels of a monitor or video display. 

Object scene data 21 also includes, as noted above, information about the movement 
10 of an object during a period of time associated with an image frame. Typically, the time 
period associated with an image frame is proportional to the shutter speed of a camera. In 
other words, the amount of time for which a camera exposes a frame of film. Any movement 
that occurs during this time period results in a blurred video frame or picture. To capture 
object movement, object scene data 21 provides the position of an object at the beginning of 
15 the period of time associated with the image frame and its trajectory and velocity during the 
time period. This permits the calculation of the position of an object at any point during the 
period of time associated with the image frame. 

Shaders 22 comprise one or more programs called shaders that also describe objects in 
an object scene. Shaders 22 are executable programs that typically provide information about 
20 the surfaces of objects in an object scene. For example, shaders 22 may be directed to 
calculate a color value of a location on the surface of an object in an object scene. The 
calculation of a color value preferably includes the consideration of an object's reflective and 
refractive qualities such as the extent of light diffusion upon reflection by the surface and the 
extent of light dispersion upon transmission through the surface. 

25 Also included in memory 20 is renderer 23. Renderer 23 processes object scene data 

21 in conjunction with shaders 22 to render computer animated video or still images as 
described below. 

Also included in memory 20, but not illustrated in Figure 1 A, is space for temporary 
storage of data produced and required by renderer 23 during the process of rendering 
30 computer animated video and still images. Object scene data 21 and shaders 22 describe an 
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object scene that Tenderer 23 samples in order to reconstruct an image or computer animated 
video. Renderer 23 stores a result of the rendering process in memory 20 and/or outputs it to 
i/o devices 30. 

In more detail, renderer 23 shades objects in an object scene (step 1010, Figure 1C). 
5 Typically, this step includes processing object scene data 21 to determine which objects in an 
object scene are at least partially visible from image plane 1 10. To make this determination, 
renderer 23 queries object scene data 21 to ascertain the z-depth value of a given object. The 
z-depth value is the minimum distance of an object from image plane 1 10. Renderer 23 
derives the z-depth value from the z coordinate discussed above. 

10 Renderer 23 also maintains in memory 20 "z-far" values associated with various 

regions of image plane 1 10. A z-far value represents the furthest distance of a visible object 
from image plane 1 10. Initially, each z-far value is set to infinity. Accordingly, every object 
in an object scene has a z-depth value that is less than the initial z-far values. However, as 
objects in an object scene are processed (as described in more detail below) an entire region 

15 of image plane 1 10 is associated with an object. After this occurs, renderer 23 sets the z-far 
value associated with that region to a finite value. Examples of such regions include: a sub- 
pixel, a group of sub-pixels, a pixel, a group of pixels, and image plane 1 10 itself. 

Once a z-far value associated with a given region is set to a finite value, renderer 23 
compares the z-depth value of an object within this region before processing the object. If the 
20 z-depth value exceeds the z-far value, the object is not visible from image plane 1 10. 

To improve the efficiency of the processing steps described below, renderer 23 may 
transform some objects to less complex representations. For example, renderer 23 transforms 
some objects to polygonal mesh representations. A polygonal mesh is a collection of edges, 
vertices, and polygons. Additionally, renderer 23 transforms some objects or object 

25 representations to patches of nonuniform rational B-Splines ("NURB"). A NURB is a curve 
that interpolates data. Thus, given a set of points, a curve is generated passing through all the 
points. A NURB patch is a polynomial representation. Thus, a NURB patch uses functions 
of a higher-degree than a polygonal mesh representation, which uses linear functions. The 
NURB patch representation is temporary, however, as it is diced to create grids of various 

30 pixel-sized shapes such as micropolygons. 
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After determining which objects are visible from image plane 110 and, if necessary, 
converting some of the objects to grids of micropolygons, Tenderer 23 computes one or more 
color values for various parts of an object. In the case of a grid of micropolygons, renderer 23 
determines a color value for each micropolygon in the grid of micropolygons. 

5 The process typically begins with renderer 23 directing shaders 22 to calculate a color 

value for an object at a given location. As noted above, shaders 22 describe surface 
properties of an object, which affect the color value of an object. In response, shaders 22 
often request renderer 23 to trace a ray (e.g., ray of light) to determine what is visible along 
the ray. The result of the tracing step is a factor in the determination of a color value for an 
10 object. The surface of the object that renderer 23 is shading may have various color-related 
properties that are processed in conjunction with the light source and shadow data and the 
objects reflected or refracted by the object being shaded to arrive at the color value. 

An object scene typically includes light sources that cast light source rays directly or 
indirectly onto objects included in the object scene. Additionally, an object in an object scene 

15 often obstructs light source rays such that shadows are cast on other objects in the object 
scene. The presence of shadows, or lack thereof, affects the color value computed for an 
object. Accordingly, renderer 23 accounts for this effect by positioning points on a light 
source and tracing a light source ray from each point to an object being shaded. While tracing 
each light source ray, renderer 23 processes object scene data 21 to determine if the ray 

20 intersects another object. If so, a shadow is cast on the object being shaded. As indicated 
above, renderer 23 takes this into account when computing a color value for an object. 

Another aspect of the shading process relates to refraction and reflection. Refraction 
is the turning or bending of a ray of light as it passes through an object. Reflection is the 
redirecting of light by an object. Because of the diffuse nature of most objects, objects tend 

25 to spread about or scatter light rays by reflection or refraction when the light source rays 

intersect the objects. To avoid processing all the possible directions of reflected or refracted 
light source rays, renderer 23 selects an angle of reflection or refraction. Once the angle is 
selected for the ray of refracted or reflected light, renderer 23 traces a ray of light from the 
object being shaded at the selected angle into the object scene. Renderer 23 determines 

30 which object(s) in the object scene are struck by the ray of light. Any such objects may then 
reflect or refract the traced ray of light. Thus, renderer 23 repeats this process of selecting an 
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angle of reflection or refraction, and continues tracing. A color value assigned to the light 
source ray is affected by the object(s) that are struck by the light source ray. 

Eventually, renderer 23 combines information from a variety of sources to compute a 
color value. Additionally, renderer 23 obtains a transparency value of the object from object 
scene data 21. To summarize step 1010, renderer 23 shades objects in an object scene that 
are at least partially visible from image plane 110, Memory 20 maintains information related 
to this step for subsequent processing. 

In the next processing step, renderer 23 distributes a set of line samples across image 
plane 1 10 (step 1020). Renderer 23 uses a non-regular sequence of numbers when 
distributing line samples to eliminate or minimize "aliasing." 

Aliasing often results when an object scene containing sharp changes is approximated 
with discrete samples. The failure to include an element of non-regularity (e.g., a non-regular 
sequence of numbers) into the sampling process aggravates the aliasing problem. More 
specifically, sampling based on a regular sequence of numbers results in low-frequency 
patterns that are not part of the sampled image and easily detectable by the human eye. 
Sampling based on a non-regular sequence of numbers results in high-frequency patterns that 
are not as easily detectable by the human eye. Figure 2A illustrates sampling based on 
regular and non-regular sequences of numbers. The image on the left is a product of 
sampling based on a regular sequence of numbers and the image on the right is a product of 
sampling based on a random sequence of numbers. In the image on the right, the center 
portion of the image is fuzzy or gray, but the center portion of the image on the left includes 
swirling patterns. The swirling patterns are an example the low-frequency patterns mentioned 
above, and are a manifestation of aliasing. The fuzzy or gray portion of the image on the 
right are an example of the high-frequency patterns mentioned above, and are also a 
manifestation of aliasing. However, persons skilled in the art generally agree that for most 
applications, high-frequency patterns are much preferable to low-frequency patterns. 

The non-regular sequence of numbers used to avoid or minimize low frequency 
patterns is preferably a pseudo-random sequence of numbers ("PRSN") or a low discrepancy 
sequence of numbers ("LDSN"). A PRSN matches that of a random sequence of numbers 
over a finite set of numbers. A LDSN avoids certain drawbacks of a PRSN. Mainly, a PRSN 
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often includes a short sequence of clustered numbers (e.g., 1, 4, 4, 4, 2, etc.) that results in 
neighboring line samples having a similar position. A LDSN by definition is not random. 
Instead, a LDSN is a uniform distribution of numbers that is not regular, but that does not 
have the number-clustering associated with random sequences of numbers. In other words, a 
5 LDSN is more uniform than a PRSN. 

Some embodiments of the present invention include a LDSN or PRSN in memory 20. 
In these embodiments, Tenderer 23 steps through a sequence of numbers maintained in 
memory 20 to obtain numbers for sampling information in object scene data 21. The 
sequence of numbers is thus ideally large enough to avoid short term repetitiveness. In other 
10 embodiments, renderer 23 directs CPU 10 and operating system 24 to compute a sequence of 
numbers as needed. 

Another element of preferred embodiments of the present invention is subdividing a 
pixel to position one or more line samples within each sub-pixel. In this regard, confining 
one or more line samples to sub-pixels provides for a more uniform or stratified distribution 
15 of line samples (i.e., minimizes line sample clustering). A more uniform distribution of line 
samples minimizes the possibility of line samples missing objects or changes in an object. 

Consider pixel 2030 of Figure 2B. Because pixel 2030 lacks subdivisions, line 
samples can cluster within a region of pixel 2030. In this example, the line samples 
distributed within pixel 2030 miss all objects or changes in the object scene confined to the 
20 lower region of pixel 2030. In contrast, pixel 2040 includes four sub-pixels. Renderer 23 
distributes a single line sample within each of these sub-pixels. Accordingly, the line 
samples are less likely to miss objects or changes in the object scene that are confined to the 
lower region of pixel 2030. 

In another embodiment of the present invention, renderer 23 selects an orientation and 
25 translation amount by reference to a non-regular sequence of numbers to position a line 

sample. Figure 3A illustrates line sample 3060 sampling sub-pixel 3025 in accordance with 
this embodiment of the present invention. Renderer 23 selects an orientation above a 
horizontal axis of sub-pixel 3025. In Figure 3 A, the selected orientation is 135-degrees and 
represented as0 . Initially, renderer 23 positions line sample 3060 at a translation origin of 
30 sub-pixel 3025 as illustrated by the lightly-shaded line sample 3060 in Figure 3 A. From this 
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position, Tenderer 23 extends vector 3040 perpendicularly from line sample 3060. Renderer 
23 then selects a translation amount. Renderer 23 translates line sample 3060 along vector 
3040 by the selected translation amount to a position within sub-pixel 3025 as illustrated by 
the darkly-shaded line sample 3060 in Figure 3A. In effect, renderer 23 selects a plane with 
5 the selected orientation through which line sample 3060 passes. Renderer 23 preferably 
maintains the 135-degree orientation of line sample 3060 as it translates line sample 3060 
along vector 3040. 

Attention now turns to a more detailed description of this embodiment of the 
invention. In a first processing step, renderer 23 selects an orientation by reference to a non- 
10 regular sequence of numbers (step 3010, Figure 3B). Preferably, the sequence of numbers is 
a PRSN or LDSN. Typically, each number in the sequence of numbers is a fractional number 
between zero and one. Renderer 23 multiplies this number by a range of numbers suitable for 
the task at hand. In this embodiment, the range of acceptable orientations is 0 to 180-degrees. 
Accordingly, renderer 23 multiplies a number from the non-regular sequence of numbers by 
15 180. 

In a next step, renderer 23 determines a translation origin of the sub-pixel (step 3020). 
The orientation selected in step 3010 dictates the outcome of this step. Figure 3C illustrates 
the four translation origins of sub-pixel 3025. Note that in this illustration, the dimensions of 
sub-pixel 3025 are set to one as an arbitrary unit of measure. 

20 For an orientation greater than or equal to 0-degrees but less than 45-degrees, renderer 

23 selects translation origin (1,0). This means that renderer 23 translates a line sample 3060 
having an orientation within this range from a position beginning at translation origin (1,0) as 
illustrated in Figure 3D ( 0 is equal to 30-degrees). For an orientation greater than or equal to 

45-degrees but less than 90-degrees, renderer 23 selects translation origin (0,1). For an 
25 orientation greater than or equal to 90-degrees but less than 135-degrees, renderer 23 selects 
translation origin (0,0). And for an orientation greater than or equal to 135-degrees but less 
than 180-degrees, renderer 23 selects translation origin (1,1). Table 1 summarizes these 
translation origin selection rules. 



Orientation (0 ) 



Translation origin 
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0 < 0 < 45 


(1,0) 


45 s 0 < 90 


(0,1) 


9O<0<135 


(0,0) 


135<0<18O 


(1,1) 



5 Table 1 

In a next step, Tenderer 23 projects vector 3040 into sub-pixel 3025 from translation 
origin (1,0) in a direction that is perpendicular to line sample 3060 (step 3030). Specifically, 
for the example illustrated in Figure 3D, vector 3040 has an orientation of 120-degrees above 
the horizontal axis of sub-pixel 3025. 

10 Renderer 23 then calculates a translation range for line sample 3060 (step 3040). The 

size of the sub-pixel and the selected orientation dictate the translation range. Specifically, 
the translation range assures that at least a portion of line sample 3060 crosses sub-pixel 3025 
after renderer 23 translates line sample 3060. 

In Figure 3D, / represents the translation range of line sample 3060. Because vector 
15 3040 is perpendicular to line sample 3060, the angle between the vertical axis of sub-pixel 
3025 that passes through translation origin (1,0) and vector 3040 is equal io(f> as well. 

Additionally, the angle between hypotenuse h and the vertical axis of sub-pixel 3025 that 
passes through translation origin (1,0) is 45-degrees. Thus© is equal to 45-degrees 
minus (f) as indicated in Figure 3D. 

20 Renderer 23 therefore calculates translation range / with the following equation: 

(1) t = h xcos(0) 
where 

h =^]x 2 + y 2 , 
x = the width of sub-pixel 3025, 
25 y = the height of sub-pixel 3025, and 
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0 = 45°- 



Thus, 



(2) t = V* 2 + r xcos(0) 



where 0 = 45°-0 



Once translation range f is determined, renderer 23 multiplies translation range t by a 

number from a non-regular sequence of numbers (step 3050). As noted above, each number 
from the non-regular sequence of numbers is between zero and one, so the actual translation 
amount is a fraction of translation range t. 

Renderer 23 then translates line sample 3060 along vector 3040 by an amount 
determined in step 3050 (step 3060). Preferably, renderer 23 does not alter the orientation of 
line sample 3060 during the translation process. Additionally, renderer 23 preferably extends 
line sample 3060 to the borders of sub-pixel 3025 as illustrated in Figure 3D. 

The process of determining translation range t is essentially the same for the other 
three origins. The only distinction worth noting is that 0 is different for each translation 
origin. For example, Figure 3E shows line sample 3060 with an orientation of 60-degrees 
above a horizontal axis of sub-pixel 3025. Consistent with Table 1, line sample 3060 initially 
passes through the (0,1) translation origin. Consistent with the illustration of angles in Figure 
3E, the equation for determining the translation range t is as follows: 



Similarly, Figure 3F shows line sample 3060 with an orientation of 1 10-degrees. 
Consistent with Table 1, line sample 3060 initially passes through the (0,0) translation origin. 
Consistent with the illustration of angles in Figure 3F, the equation for determining the 
translation range t is as follows: 



(3) 




where 0 = 0-45° 



(4) 




where 0 = 135°-0 
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Finally, Figure 3G shows line sample 3060 with an orientation of 1 10-degrees. 
Consistent with Table 1, line sample 3060 initially passes through the (1,1) translation origin. 
Figure 3G also shows line sample 3060 translated a translation range t. Consistent with the 
illustration of angles in Figure 3G, the equation for determining the translation range t is as 
follows: 



In another embodiment, renderer 23 selects an orientation and an area by reference to 
a non-regular sequence of numbers. Renderer 23 selects an orientation above a horizontal 
axis of sub-pixel 3025. Renderer 23 then selects an area formed by a line sample translated 
along a vector perpendicular to the line sample. Additionally, renderer 23 calculates a 
translation amount based on the selected area. Renderer 23 then translates line sample 3060 
along vector 3040 by the calculated amount to a position within sub-pixel 3025. Renderer 23 
preferably maintains the 135-degree orientation of line sample 3060 as it translates line 
sample 3060 along vector 3040. 

Attention now turns to a more detailed description of this embodiment. In a first 
processing step, renderer 23 selects an orientation by reference to a non-regular sequence of 
numbers (step 4010, Figure 4). Preferably, the sequence of numbers is a PRSN or a LDSN. 
Typically, each number in the sequence of numbers is a fractional number between zero and 
one. Renderer 23 multiplies this number by a range of numbers suitable for the task at hand. 
In this embodiment, the range of acceptable orientations is 0 to 180-degrees. Accordingly, 
renderer 23 selects an orientation by multiplying a number from the non-regular sequence of 
numbers by 180. 

In a next step, renderer 23 selects a translation origin of the sub-pixel (step 4020). 
The orientation selected in step 4010 determines the outcome of this step. For an orientation 
greater than or equal to 0-degrees and less than 45-degrees, renderer 23 selects translation 
origin (1,0). This means that renderer 23 translates line sample 3060 having an orientation 
within this range from a position beginning at translation origin (1,0) as illustrated in Figure 
4D. For an orientation greater than or equal to 45-degrees and less than 90-degrees, renderer 
23 selects translation origin (0,1). For an orientation greater than or equal to 90-degrees and 



(5) 




where 0 = 0-135° 
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less than 135-degrees, renderer 23 selects translation origin (0,0). And for an orientation 
greater than or equal to 135-degrees and less than 180-degrees, renderer 23 selects translation 
origin (1,1). Thus, this embodiment of the invention adheres to the translation origin 
selection rules listed in Table 1. 

5 Renderer 23 then selects an area by reference to a non-regular sequence of numbers 

(step 4030). Preferably, the sequence of numbers is a PRSN or a LDSN. Typically, each 
number in the sequence of numbers is a fractional number between zero and one. Renderer 
23 multiplies this number by a range of numbers suitable for the task at hand. In this 
example, the area of a sub-pixel is one square unit. Accordingly, renderer 23 selects an area 
10 in this example by multiplying a number from the non-regular sequence of numbers by 1. 

From the area selected in step 4030, renderer 23 calculates a translation amount (step 
4040). To facilitate the calculation of a translation amount, renderer 23 subdivides sub-pixel 
3025 to form the regions areaO, areal, and area3, which are illustrated in Figure 4B. In 
particular, Figure 4B illustrates a general case for an orientation between 90 and 135-degrees 

15 above a horizontal axis of sub-pixel 3025. If 0 < t < tO , line sample 3060 and sub-pixel 
3025 form triangle areaO. If tO < t < t\ , line sample 3060 and sub-pixel 3025 form 
parallelogram areal. And if t\ < t < t2 , line sample 3060 and sub-pixel 3025 form triangle 
area2, which is equal in size to areaO. The area of areaO, areal, and area2, which Figure 4B 
illustrates, is a function of t - the amount by which renderer 23 translates line sample 3060 

20 along vector 3040. A function, area(0, that calculates the total area formed by line sample 
3060 and sub-pixel 3025 is, therefore, the sum of three functions: areaO(r), area 1(f), and 
area2(r). 

To develop function area(f), first consider areaO(r) for 0 < / < tO , wherein the 
intersection of line sample 3060 and sub-pixel 3025 form areaO as illustrated in Figure 4B. 

25 The triangle is itself formed by two right triangles as illustrated by sub-areal and sub-area2, 
the shaded regions of areaO in Figure 4C. A portion of sub-pixel 3025, a portion of line 
sample 3060, and a portion of vector 3040 form sub-areal. The portion of vector 3040 that 
forms sub-areal is equal in length to t. Further, the slope s of h(t) relative to line sample 
3060 is equal to the rise over the run of h(f), i.e., t divided by the length of that portion of line 

30 sample 3060 that forms sub-areal. Using substitution, this portion of line sample 3060 is 
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therefore equal in length to — . Plugging this information into the Pythagorean Theorem 

s 

solves for the length of h(t): 



t 2 1 
(6) h(t) 2 =t 2 + — =>h(t) = tJ\ + - T 

s V s 

where 5 = cot(0) 



5 A portion of sub-pixel 3025, a portion of line sample 3060, and a portion of vector 

3040 also form sub-area2. And as illustrated in Figure 4C, the portion of vector 3040 that 
forms sub-area2 is also equal in length to t. Similarly, the slope s of b(t) is equal to the rise 
over the run of b(r), i.e., the length of the portion of line sample 3060 that forms sub-area2 
divided by t. Using substitution, this portion of line sample 3060 is therefore equal in length 
10 to t X s . Plugging this information into the Pythagorean Theorem solves for the length of 
b(f): 

( 7) b(t) 2 = r + /V =>b(t) = rVTTT 7 

where s - cot(0) 

Recall that line sample 3060, b(t), and h(t) form areaO(t). Plugging equations (6) and 
15 (7) into an equation solving for the area of a right triangle produces function area0(/): 



b(t)h(t) 1 7 ? 1 1 2 1 

(8) area0(0= " = - 't 2 J2 + S" + • ^ = ~ -t 2 (s ■+ - -) 



As illustrated in Figure 4C, h(0 is equal to the height of sub-pixel 3025 when / is 
equal to tO since line sample 3060 passes through translation origin (0,1) at that t. Thus, the 
following equation solves for t at tO: 

I r s 

20 (9) h(t) = tJl + —=>? = 



. s 2 V5T7 

where ; = tO 

Further, plugging equation (9) into equation (8) solves areaO(r) at tO as follows: 



2 1 2 1 

1 s 2 (s + ~) j s 2 (s + ~) s 

(10) area0(0= - * = ~ f~ = ~ 

s(s + — ) 
s 

- 17 - 



WO 02/097728 



PCT/US02/16356 



where t = tO 

Additionally, b(r) is equal to the width of sub-pixel 3025 when / is equal to tl since 
line sample 3060 passes through translation origin (1,0) at that t, as illustrated in Figure 4C. 
Thus, the following equation solves t at tl: 

1 



(11) b{t) = ty[\ + s 2 => t = 
where / = tl 



And because of the similarity between areaO and area2: 

s + 1 

(12) /2-/l = r0 => r2 = rO + fl = 

Thus, 



10 (13) area2(r) = areaO - area0(t2 - t) 
where / > tl 

Using equation (8), equation (13) is rewritten as follows: 

1 2 1 

(14) areal{t) = areaQ--(t2 -t) 2 (s + -) 

2 s 

where t > tl 

15 Further, the areal(r) is swept out linearly as t increases from tO to tl. Areal(/) is 

therefore solved as follows: 
t-tO 

(15) area\(t) = - — — (1 -2area0) 

where 

t > tO 
t -tO 

20 — xs t ' ie percentage of areal swept out by line sample 3060, and 

(1 - 2area0) is the area of areal in terms of areaO. 

Using equation (10), equation (15) is rewritten as follows: 
t -fO 

(16) area\(t) = ^—^(\-s) 
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where 



r>t0 
t-tO 



is the percentage of areal swept out by line sample 3060, and 



fl-rO 

(1-5) is the area of areal in terms of s 



Thus function area(t) is written as follows: 

1 , 1 

-t 2 (s + -),0 < t < tO 

2 s 

s t-tO 

(17) area(0= ~ + - s),tO < t < tl 

1 . 1 
l--(/2-/) 2 (s + -),tl<t <t2 

2 s 

Inverting area(/) gives: 



y/2sA s 
•,0 < A < 



(18) w -T^^ A ^-i 



s+\-yj2s{\- A) , s A t 
< ,1 - — < A < 1 

ViT7 2 

15 where 

A is an area selected in step 4030, 

(j) is the orientation selected in step 4010, and 

s = cot(0) 
0 = 0-90° 

20 Thus, renderer 23 plugs the area selected in step 4030 into equation 18 to calculate a 

translation amount. Other techniques for deriving a translation amount are of course possible 
and within the scope of the present invention. 
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Having found f(A) (i.e., equation 18) for orientations between 90 and 135-degrees 
above a horizontal axis of sub-pixel 3025, Tenderer 23 exploits symmetries to solve for 
orientations between 0 and 45-degrees, 45 and 90-degrees, and 135 and 180-degrees. 
Renderer 23 can thus use t(A) to compute translation range t for line sample 3060 regardless 
5 of its orientation. Renderer 23 need only change the initial translation point for line sample 
3060 and0 . 

Consider line sample 3060 with an orientation, 0 , between 0 and 45-degrees above a 

horizontal axis of sub-pixel 3025, as illustrated in Figure 4D. In effect, Figure 4B is rotated 
counter-clockwise by 90-degrees. Note, however, that# now equals (j) . Otherwise, t(A) is 
10 the same for this range of orientations. 

Similarly, renderer 23 may translate line sample 3060 with an orientation between 45 
and 90-degrees from (0,1) by f(A) as illustrated in Figure 4E - effectively flipping Figure 4B 
about the horizontal axis. In this case, 9 equals 90°— (j) . Otherwise, t(A) is the same for this 
range of orientations as well. 

15 Further, renderer 23 may translate line sample 3060 with an orientation between 135 

and 180-degrees from (1,1) as illustrated in Figure 4F - effectively flipping and rotating 
Figure 4B. In this case, 6 equals 1 80°— (j) . Otherwise, r(A) is the same for this range of 
orientations as well. Table 1 is therefore extended to produce Table 2 as follows: 



Orientation ( 0 ) 


e 


Translation Origin 


0°< 0 <45° 


<t> 


(1,0) 


45°<0<9O° 


90-0 


(0,1) 


9O°<0<135° 


0 + 90 


(0,0) 


135°< 0< 180° 


180-0 


(1,1) 



Table 2 

25 In a next step, renderer 23 projects vector 3040 into sub-pixel 3025 from translation 

origin (1,0) in a direction perpendicular to line sample 3060 (step 4050). 
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Renderer 23 then translates line sample 3060 along vector 3040 by an amount 
determined in step 4040 (step 4060). Preferably, renderer 23 does not alter the orientation of 
line sample 3060 during the translation process. Additionally, renderer 23 preferably extends 
line sample 3060 to the borders of sub-pixel 3025. 

5 Using the above derived equations, renderer 23 uniformly samples the area of sub- 

pixel 3025. Figure 4G illustrates the effectiveness of the above derived equations. 1,000,000 
line samples were positioned by a randomly selected orientation and area using the above- 
described techniques. Figure 4G evidences the uniformity with which renderer 23 samples 
the area of sub-pixels in this embodiment of the invention. Specifically, in this embodiment 
10 of the present invention, the number of line samples with a given area is consistent across a 
range of areas. 

In still another embodiment of the invention, renderer 23 employs a type of stratified 
sampling to ensure uniform sampling. Renderer 23 subdivides a two-dimensional domain of 
orientation and translation to produce a number of sub-domains reflecting the number of sub- 
15 pixels in each pixel. Each sub-domain represents an orientation range and a translation range 
defined by the size of the sub-domain relative to the two-dimensional domain of orientation 
and translation and the position of sub-domain within the two-dimensional domain of 
orientation and translation. Thus, each sub-domain has a unique set of possible orientation 
and translation pairs. 

20 From each sub-domain, renderer 23 selects an orientation and translation pair. And 

because each orientation and translation pair is selected from a separate sub-domain, renderer 
23 does not select a set of clustered orientation and translation pairs. This step ultimately 
results in line samples with a more uniform distribution of orientations and translation 
amounts. Renderer 23 then assigns the orientation and translation pair to a sub-pixel by 

25 reference to a non-regular sequence of numbers (e.g., PRSN, LDSN). The use of a non- 
regular sequence of numbers prevents the assignment of an orientation and translation pair 
with a limited range to the same sub-pixel repeatedly. Renderer 23 then positions line 
samples by reference to the orientation and translation pair. 

Attention now turns to a more detailed description of this embodiment. In a first 
30 processing step, renderer 23 subdivides a two-dimensional domain of orientation and 
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translation to produce a number of sub-domains (step 5010, Figure 5 A). The two- 
dimensional domain of orientation and translation preferably includes a number of sub- 
domains that is equal to the number of sub-pixels or included in each pixel. Each of the sub- 
domains eventually produces a position for a line sample in each sub-pixel. Figure 5B 
illustrates an example of a two-dimensional domain of orientation and translation 5000 in 
accordance with this embodiment of the invention. Note that the axes of the two-dimensional 
domain of orientation and translation 5000 range from zero to one. Thus, in the particular 
example, the selected orientation and translation range is actually a percentage amount. As 
described below, renderer 23 eventually multiplies the orientation and translation pairs 
against maximum orientation and translation amounts. 

In the next processing step, renderer 23 selects an orientation and translation pair 
having a range dictated by the size and positioning of a sub-domain (step 5020). In the two- 
dimensional domain of orientation and translation 5000 of Figure 5B, each sub-domain has a 
specified size. For example, sub-domain 1 has a range of 0.5 to 1.0 along the orientation axis 
and a range of 0.0 to 0.5 along the translation. Accordingly, an orientation and translation 
pair selected from sub-domain 1 will be limited to a range of 0.5 to 1.0 or 0.0 to 0.5. For 
either range, the difference between the upper and lower range is 0.5. Accordingly, renderer 
23 selects the pair of numbers by multiplying this difference by a number from a non-regular 
sequence of numbers. The result of this step is added to the lower range along the translation 
and the orientation axises. 

The following steps illustrate the procedure for selecting an orientation and translation 
pair for sub-domain 1 in accordance with a preferred embodiment of the present invention: 

Translation axis: 

0.5 * 0.345 = 0.173 

0.0 + 0.173 = 0.173 

where 0.5 is the orientation range of the sub-domain 

where 0.345 is a number from a non-regular sequence of numbers 

where 0.173 is the x coordinate 
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Orientation axis: 

0.5 * 0.856 = 0.428 

0.428 + 0.5=0.928 

where 0.5 is the orientation range of the sub-domain 

where 0.856 is a number from a non-regular sequence of numbers 

where 0.928 is the y coordinate 

Renderer 23 preferably repeats step 5020 for each sub-domain in the two-dimensional 
domain of orientation and translation as illustrated in Figure 5B. In Figure 5B, the points are 
positioned according to an orientation and translation pair. 

In a next processing step, renderer 23 assigns the orientation and translation pairs 
selected in step 5020 to a sub-domain (step 5030). As noted above, the dimensions and 
location of a sub-domain limit an orientation and translation pair selected therefrom. Thus, 
an orientation and translation pair from sub-domain 1 will never have an x coordinate greater 
than 0.5. Similarly, the y coordinate will never be less than 0.5. However, renderer 23 uses 
the orientation and translation pairs to select an orientation and a translation amount for a line 
sample. Specifically, renderer 23 multiplies a number from the orientation and translation 
pair against a range of possible orientations for a line sample (i.e., 0 to 180-degrees). 
Because, for example, the translation value is never less than 0.5, an orientation selected by 
this value is never less than 90-degrees. Aliasing can therefore result if renderer 23 
repeatedly assigns the orientation and translation pair from sub-domain 1 to the same sub- 
pixel. 

To avoid this problem, renderer 23 assigns the orientation and translation pairs to a 
sub-pixel by reference to a non-regular sequence of numbers. This step minimizes aliasing by 
preventing the same sub-pixel from having the same orientation range each time renderer 23 
positions a line sample within the sub-pixel. 

Renderer 23 preferably accomplishes this by repeating the following sequences of 
steps for each sub-pixel in a pixel: 
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where the number is between 0 and 1; 
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multiply the number from the sequence of non-regular numbers by the number of sub- 
pixels included in a pixel; 

5 extract an integer value from the result of the multiplying step; 

where renderer 23 extracts the number by, for example, rounding or truncating; 

and 

assign an orientation and translation pair to a sub-pixel by reference to the result of the 
extracting step. 

10 Figure 5C illustrates the assignment of orientation and translation pairs to sub-pixels 

in pixel 5010. The orientation and translation pair from sub-domain 0 is assigned to sub- 
pixel 3, the orientation and translation pair from sub-domain 1 is assigned to sub-pixel 0, the 
orientation and translation pair from sub-domain 2 is assigned to sub-pixel 1, and the 
orientation and translation pair from sub-domain 3 is assigned to sub-pixel 2. 

15 Once assigned to a sub-pixel, renderer 23 uses an orientation and translation pair to 

position a line sample within the sub-pixel (step 5040). Preferably, renderer 23 uses a line 
sample positioning technique described above to position the line sample, but other 
techniques are within the scope of the present invention. 

Note that in alternative embodiments of the invention, the number of sub-domains is 
20 not equal to the number of sub-pixels included in each pixel. Instead, the number of sub- 
domains is equal to the number of line samples included in some other defined region of the 
image plane. For example, the number of sub-domains is equal to the number of line samples 
distributed within a set of pixels or the entire image plane. Additionally, in some 
embodiments of the invention, line samples are not restricted to separate regions of the image 
25 plane (e.g., sub-pixels). In these embodiments, orientation and translation pairs are assigned 
to line samples instead of sub-pixels as described above. 

In still another embodiment of the invention, renderer 23 takes additional steps to 
assure a uniform distribution of line samples by employing best candidate techniques. 
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Renderer 23 positions a line sample within a first sub-pixel by reference to a non-regular 
sequence of numbers. Renderer 23 then positions a set of line samples within a neighboring 
or adjacent sub-pixel by reference to a non-regular sequence of numbers. Renderer 23 then 
scores each line sample in the set of line samples by reference to the line sample positioned in 
5 the first sub-pixel. While the precise scoring technique can vary without departing from the 
scope of the invention, the scoring preferably ensures that neighboring or adjacent line 
samples are not too close together or too similarly oriented. 

Renderer 23 then selects the line sample with the best score from the set of line 
samples and repeats this step for each sub-pixel. However, renderer 23 extends this scoring 
10 process to include each line sample selected from a group of sub-pixels, which may or may 
not extend beyond the border of a pixel. Thus, for a third line sample, the scoring process 
favors an orientation that is most different from the orientation of the first and second line 
sample and most distant from the first and second line sample. 

Attention now turns to a more detailed description of this embodiment. In a first 
15 processing step, renderer 23 positions a first line sample within a sub-pixel (step 6010, Figure 
6A). The precise technique used to position the line sample is variable without departing 
from the scope of the invention. However, renderer 23 selects an orientation and translation 
amount by reference to a non-regular sequence of numbers. Figure 6B illustrates pixel 6000 
subdivided to form four sub-pixels. Included in the upper, left sub-pixel is line sample 6010, 
20 selected in accordance with step 6010. 

Renderer 23 then positions a set of line samples within a neighboring or adjacent sub- 
pixel (step 6020). A number of positioning techniques are possible without departing from 
the scope of the invention. For example, some embodiments of the invention use the 
stratified line sampling method described above. Instead of distributing the orientation and 

25 translation pairs to an equal number of sub-pixels as described above, however, renderer 23 
uses all of the orientation and translation pairs to position the set of line samples in a single 
sub-pixel. Incorporating stratified line sampling in this manner eliminates the possibility of a 
clustered set of line samples. Also included in Figure 6B is a set of line samples, consisting 
of line sample 6020 and line sample 6030 distributed in the upper, right sub-pixel of pixel 

30 6000. In this example, the set of line samples comprises two line samples, but the invention 
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is not so limited. The inclusion of more line samples will typically result in a more uniform 
distribution of line samples by broadening the selection of line samples. 

Renderer 23 then scores each line sample in the set of line samples by reference to the 
first line sample positioned in step 6010 (step 6030). Again, the precise scoring technique 
5 can vary without departing from the scope of the invention, but the scoring preferably ensures 
that neighboring or adjacent line samples are not too close together or too similarly oriented. 
In a preferred embodiment, the scoring process includes comparing the orientation of the first 
line sample to the orientation of a line sample from the set of line samples. 

If the first line sample is not perpendicular to the line sample from the set of line 
10 samples, there are necessarily two different angles between the two line samples. To 
determine the minimum angle of the two different angles, renderer 23 determines the 
difference between the selected orientation. If the result of this step is greater than 90- 
degrees, this result is the maximum angle between the two line samples. Renderer 23 
subtracts 90-degrees from the maximum angle to get the minimum angle between the two 
15 orientations. 

To illustrate the comparison, Figure 6C shows a first selected line sample, line sample 
6010, superimposed over a line sample, line sample 6030, from a set of line samples 
distributed in an adjacent sub-pixel. The selected orientation of line sample 6010 and line 
sample 6030 sweeps each line sample away from reference axis 6040. As illustrated in 
20 Figure 6C, the orientation of line sample 6010 is 45-degrees and the orientation of line 

sample 6030 is 170-degrees from reference axis 6040. The difference between these two 
orientations is 125-degrees. Because the difference is greater than 90-degrees, renderer 23 
subtracts 90-degrees from this amount to arrive at 35-degrees, the minimum angle between 
line sample 6010 and line sample 6030. 

25 In another illustration, Figure 6D shows line sample 6010 superimposed over line 

sample 6020, another line sample from the set of line sample distributed in an adjacent sub- 
pixel. As illustrated in Figure 6D, the orientation of line sample 6010 is 45-degrees and the 
orientation of line sample 6020 is 105-degrees from reference axis 6040. The difference 
between these two orientations is 60-degrees. 60-degrees is the minimum angle between line 

30 sample 6010 and line sample 6020 because it is less than or equal to 90-degrees. 
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In addition to comparing orientations, a preferred embodiment also includes a 
comparison of the distance between the first line sample and a line sample from the set of line 
samples. There are a number of techniques available for comparing the distance between two 
line samples without departing from the scope of the invention. In a preferred embodiment, 
renderer 23 determines the closest approach between the two line samples at any point along 
each line. In other embodiments, Tenderer 23 determines the closest approach by reference to 
a midway point along each line sample. 

Preferably, renderer 23 normalizes both the closest approach and minimum angle to 
equalize the contribution of each to the overall score. Renderer 23 preferably divides the 
minimum angle by 90-degrees to obtain a value between zero and one since the minimum 
angle is between 0 and 90-degrees. Additionally, renderer 23 preferably divides the closest 
approach by the maximum distance between any two points in the relevant sub-pixels. 

Renderer 23 then combines the minimum angle and closest approach by, for example, 
multiplying the two values. In other embodiments, renderer 23 adjusts one or both of the 
values so that one of the values is a more significant factor in the scoring process. 

The following equation illustrates the scoring techniques described above: 



(19) score=fl( 



angle 
90 



)+b( 



max dist 



dist 



where 



angle m is the minimum angle between the first line sample and a second 



line sample; 



dist is the distance between the first line sample and a second line 



sample; 



max dist is the maximum possible distance between the first line 



sample and a second line sample; 
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a is a factor that adjusts the contribution of the minimum angle to the 



score; and 

b is a factor that adjusts the contribution of the distance to the score. 

After scoring one or more line samples from the set of line samples distributed in step 
5 6020, Tenderer 23 selects a line sample (step 6040). Because the preferred embodiments of 
the invention seek to maximize the distance and angle between line samples, renderer 23 
selects the line sample with the highest score. But some embodiments do not require this 
since these embodiments emphasize different attributes in a distribution of line samples. 

Depending on the needs of a particular embodiment of the invention, renderer 23 
10 distributes a set of line samples within another sub-pixel (step 6050). As with the positioning 
of line samples in step 6020, renderer 23 preferably positions the line samples by applying the 
line sample positioning techniques described above. 

Renderer 23 then scores each line sample in this set of line samples by reference to the 
first and second line samples positioned and selected in steps 6010 and 6040 respectively 

15 (step 6060). The scoring process is essentially the same as that described with reference to 

step 6030. However, combining the individual scores to determine an overall score is subject 
to a great deal of variation. Again, the general goal is to select a line sample having a 
maximum distance and orientation from the first and second line samples. An example of a 
variation is giving more weight to line samples positioned within sub-pixels that are closest to 

20 the sub-pixel containing the line sample being scored. Additionally, renderer 23 may assign 
relatively more weight to sub-pixels that share a pixel. The scoring process in preferred 
embodiments of the present invention thus includes line samples distributed within 
neighboring or adjacent pixels even though Figure 6B illustrates only a single pixel. As 
described in greater detail below, renderer 23 preferably determines a color value for a pixel 

25 by combining color values for a plurality of line samples. The number of line samples used is 
variable. For example, some embodiments combine line samples from neighboring pixels to 
compute a color value for a given pixel. In these embodiments, renderer 23 preferably 
extends the scoring process to include all line samples included in the given pixel and its 
neighboring pixels. Other variations are possible without departing from the scope of the 

30 invention. 
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Accordingly, equation (19) is extended as follows: 
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anglem dist angle m dist 

(20) scores ci[a( * ) + b( — )]i + ci[a{ — — ) + b{ — )}i + ... 

90 mzxdist 90 maxdist 

anglem dist 

+ Cn[a(^—) + b( — )]■ 

90 maxdist 

where 

5 c is a weight attributed to each line sample's contribution to the overall 

score; 

n is the number of line samples against which renderer 23 scores a 

candidate line sample. 

Weight c is, depending on the embodiment, a reflection of the distance between a 
10 candidate line sample and an already-selected line sample, a reflection of whether the 

candidate line sample and an already-selected line sample are within the same pixel, or both. 

After scoring one or more line samples from the set of line samples distributed in step 
6050, renderer 23 selects a line sample (step 6070). Because preferred embodiments of the 
invention seek to maximize the distance and angle between line samples, renderer 23 selects 
15 the line sample with the best score. But some embodiments do not require this since they 
emphasize different attributes in a distribution of line samples. 

In the above-described embodiment, each line sample is selected separately, in a linear 
fashion. That is, renderer 23 positions a first line sample, and selects a second line sample 
from a set of line samples by reference to the first line sample. Renderer 23 then selects a 
20 third line sample by reference to the first and second line samples. Renderer 23 extends this 
process as needed. 

However, in alternative embodiments, sets of line samples are selected together, rather 
than individually. In these embodiments, renderer 23 distributes a set of line samples in a 
region (e.g., a set of pixels) of image plane 1 10. Renderer 23 then selects a subset of the set 
25 of line samples. For example, renderer 23 selects one line sample from each sub-region (e.g., 
a sub-pixel). Renderer 23 then scores the sub-set of line samples. The scoring process is 
similar to the scoring process described above. Essentially, the score reflects an average 
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minimum angle and distance between each line sample in the subset of line samples. 
Renderer 23 then selects and scores a second subset of line samples from the set of line 
samples. Renderer 23 continues the selecting and scoring subsets until a suitable number of 
subsets are selected and scored. Renderer 23 then uses the subset having the best score. Note 
5 that various techniques are available to improve the efficiency of these embodiments. In 
particular, a great deal of work has been done on so-called "traveling salesman" problems, 
which involve computing a route between a set of cities. Typically, the work involves the 
application of heuristics. The problem of selecting line sample positions is stated such that 
the minimum angle and distance between two line samples is thought of as the cost of 
10 traveling between to cities. This embodiment of the invention is, therefore, preferably 

optimized with simulated annealing, which has known application to the traveling salesman 
problem. 

In still another embodiment of the present invention, renderer 23 distributes line 
samples in time. As noted above, object scene data 21 maintains information about the 

15 movement of objects during a time period associated with an image frame. To simulate 
motion blur, renderer 23 selects a specific period of time for each line sample. More 
specifically, renderer 23 multiplies the period of time associated with the image frame by a 
number from a non-regular sequence of numbers. Each of the numbers in the non-regular 
sequence of numbers is between zero and one so the result of the multiplication is a fraction 

20 of the time period. Memory 20 maintains the selected time period for each line sample along 
with other information in association with each line sample. Note that in preferred 
embodiments, renderer 23 takes additional steps to assure a uniform distribution of selected 
times. Accordingly, renderer 23 takes steps analogous to those taken and described above 
when selecting a position for a line sample when selecting a time for the line sample. 

25 After a set of line samples is distributed using an above-described or other 

embodiment of the present invention, renderer 23 projects objects from an object scene onto 
image plane 1 10 as illustrated in Figure IB (step 1030, Figure 1C). As a preliminary step, 
renderer 23 determines whether an object is within a region that includes a line sample being 
processed. 
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Renderer 23 preferably encloses a candidate object in a bounding box before making 
this determination. Renderer 23 accesses object scene data 21 to determine the size and 
position of the object being processed. 

The bounding box loosely follows the contours of the object. It is generally easier to 
5 determine whether the object is within a region of a line sample through the use of a 

bounding box because the bounding box lacks shape or surface complexity possessed by 
some objects. Typically, the region of a line sample includes the area that the pixel or sub- 
pixel containing the line sample overlaps. If the bounding box is not within a region of the 
line sample, renderer 23 processes a different candidate object. 

10 As noted above, renderer 23 preferably distributes line samples in a period of time 

associated with an image frame. Accordingly, the movement of an object during this period 
of time complicates the step of determining whether a line sample, sub-pixel, or pixel 
overlaps an object. To address this movement, the bounding box actually stretches to enclose 
the object during its movement within the period of time associated with the image frame. 

15 If the bounding box is within a region of the line sample, renderer 23 may convert the 

object to a grid of micropolygons. A grid of micropolygons is often easier to project onto 
image plane 110 and sample with line samples (as described below) than objects with 
complex surfaces (e.g., smoothly varying surfaces). Additionally, it is computationally less 
complex to enclose a grid of micropolygons tightly within a bounding box. In other words, 

20 renderer 23 is able to determine more precisely if a region around a line sample overlaps the 
object. Thus, renderer 23 may also take the step of enclosing the grid of micropolygons 
within a bounding box. Again, if the bounding box is not within a region of the line sample, 
renderer 23 processes a different candidate object. 

Renderer 23 then transforms the object (possibly in the form of a grid of 
25 micropolygons) to the precise time of a line sample. Additionally, renderer 23 selects a lens 
position for the line sample being processed. Renderer 23 then transforms the object 
according to the lens position assigned to that line sample. 

As noted above, renderer 23 simulates limited depth of field. To do so, renderer 23 
associates a point a on aperture 7000 with each line sample on image plane 1 10 as illustrated 
30 in Figure 7 (line sample not illustrated). Renderer 23 may choose the points using a regular 
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pattern, through a stochastic process, or by way of stratification. Because a is a single point 
on the aperture, the image it forms on image plane 1 10 is a 'pinhole' image that renderer 23 
computes using standard projection techniques. 

Renderer 23 projects an object onto image plane 1 10 once through c, and then 
5 translates the object for each line sample that overlaps the object. Renderer 23 translates the 
object by (pc-pa), where pc is the position of the object on image plane 1 10 if projected 
through c and pa is the position of the object on image plane 1 10 if projected through a. 

To compute (pc-pa), renderer 23 makes use of a function B(p), which defines a scaling 
factor of the circle of confusion (i.e., the area of image plane 1 10 into which renderer 23 
10 projects p) associated with the point p relative to aperture 7000. Thus, (pc-pa) equal (a- 
c)*B(p). 

In a traditional camera model, the camera is parameterized by its focal length, f, an 
aperture number, n, and a distance from the aperture at which the camera is focused, D. If the 
camera of the axis is aligned with the z axis, renderer 23 computes the circle of confusion for 

/ z fD 

15 a traditional camera model as C(p) = — (1 7), where Z=— — - is the distance from the 

n P z D-f 

fa 

aperture to image of the plane of focus, and p, ^~ is the distance along the camera 

Pz-J 

axis from the aperture to p\ the image of p. Because f/n defines the diameter of the aperture, 
for a traditional camera system renderer 23 might write the blur scaling function as 

B(p) =a-4>=^ef 

Pz Pz D ~f 

20 The present invention is not, however, limited to traditional camera models. Instead, 

the present invention uses any smoothly-varying function of p to, for example, have multiple 
planes of focus. 

Renderer 23 furthermore defines a function Fq(l,p) to 'filter' a value of a quantity (e.g. 
color) associated with a point or object p when p is viewed through point 1 on the aperture. 
25 Example uses of F include modifying the shape of the circle of confusion or changing the 
brightness of the circle of confusion as a function of aperture or object position, and so on. 
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After Tenderer 23 projects the object onto image plane 110, renderer 23 computes the 
view of an object scene along the line sample being processed (step 1040). Since a line 
sample can overlap multiple objects, renderer 23 must determine and mark each segment of 
the line sample that overlaps a portion of an object. Renderer 23 then stores this information 
5 in memory 20 in association with the line sample. Renderer 23 repeats this step for each 
object projected on to image plane 1 10. Additionally, renderer 23 determines which of the 
objects overlapped by the line sample being processed are closest to image plane 1 10. 

Figure 8A illustrates the result of projecting object 8010 onto image plane 110 in the 
area of pixel 8000. In this particular illustration, renderer 23 is processing line sample 8020. 

10 The sub-steps of step 1040 are described in greater detail with reference to Figure 8B. 

In a first sub-step, renderer 23 isolates a new segment of line sample 8020 that overlaps 
object 8010 (step 8010). More specifically, renderer 23 determines the end-point coordinates 
t 0 and t, of a new segment as illustrated in Figure 8A. 

After determining end-point coordinates t 0 and t,, renderer 23 calculates the distance 
15 of object 8010 from image plane 1 10 at the end-point coordinates ^ and t, (step 8020). 

Additionally, renderer 23 obtains the transparency value and color value as described with 
reference to step 1010 (step 8022). 

If the transparency value obtained in step 8022 indicates that the object associated 
with the new segment is transparent (step 8024-Yes), renderer 23 stores information related to 
20 the segment in memory 20 for subsequent processing as described in detail below (step 
8080). In particular, step 8080 includes adding the segment to a transparency list also 
maintained in memory 20. Renderer 23 then returns to step 1030 to project another object 
onto image plane 1 10. 

If the transparency value obtained in step 8022 indicates that the object associated 
25 with the new segment is not transparent (step 8024-No), renderer 23 determines whether there 
is an overlap between an old segment (i.e., a segment already processed and stored in memory 
20) and the new segment (step 8028). Renderer 23 accomplishes this by a comparison of 
end-point coordinates associated with the new segment and an old segment. 
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If there is no overlap between an old segment and the new segment (step 8032-No), 
Tenderer 23 stores information related to the new segment (e.g., end-point coordinates, 
transparency value, color value) in memory 20 (step 8080). Renderer 23 then returns to step 
1030 to project another object onto image plane 1 10. 

5 In the example illustrated in Figure 8 A, no other segments are present because object 

8010 is the first object projected onto image plane 1 10. 

After returning to step 1030, renderer 23 projects additional objects onto image plane 
110 (step 1030). Renderer 23 executes steps 8010 through 8028 for additional objects 
projected onto image plane 1 10. If an additional object is not transparent and there is an 

10 overlap between a segment associated with the additional object and an old segment (step 

8032-Yes), renderer 23 determines the state of occlusion between the object associated with 
the new segment and the object associated with the old segment (step 8028). Renderer 23 
makes this determination by evaluating the end-point coordinates of each segment and the z- 
depth values of the objects associated with the two segments at those coordinates. 

15 Essentially, renderer 23 determines whether the object associated with the new segment or the 
object associated with the old segment occludes the other (i.e., is closer to image plane 1 10) 
where there is an overlap between the two segments and line sample 8020. 

If the object associated with the old segment completely occludes the object 
associated with the new segment (step 8038-Yes), renderer 23 determines if the new segment 

20 overlaps another old segment (step 8070). If so (step 8070- Yes), renderer 23 returns to step 
8028, which is described above. If not (step 8070-No), renderer 23 stores in memory 20 
information related to the portions of the new segment (e.g., end-point coordinates, 
transparency value, color value), if any, for which there is no overlap with an older segment 
in memory 20 (step 8080). Renderer 23 then returns to step 1030 to project another object 

25 onto image plane 1 10. 

If the object associated with the new segment completely occludes the object 
associated with the old segment (step 8038-No, step 8040- Yes), renderer 23 computes the z- 
depth values of the object associated with the new segment at positions overlapped by the 
end-point coordinates of the old segment and updates the old segment's information with the 
30 new z-depth values and other information related to the new segment (step 8050). 
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Figure 8D illustrates object 8030 projected onto image plane 1 10 such that object 
8030 completely occludes object 8010 where object 8030, object 8010, and line sample 8020 
overlap. Accordingly, object 8010 is not visible along line sample 8020. 

Renderer 23 then determines if the new segment overlaps another old segment (step 
5 8070). If so (step 8070- Yes), renderer 23 returns to step 8028, which is described above. If 
not (step 8070-No), renderer 23 stores in memory 20 information related to the portions of the 
new segment (e.g., end-point coordinates, transparency value, color value), if any, for which 
there is no overlap with an older segment in memory 20 (step 8080). Renderer 23 then 
returns to step 1030 to project another object onto image plane 1 10. 

10 If the new segment only partially occludes the old segment (step 8038-No, step 8040- 

No), renderer 23 adjusts an end-point of the old segment to reflect the intersection with the 
new segment (step 8060). Renderer 23 also sets the z-depth value associated with the 
adjusted end-point to reflect the z-depth value of the object associated with the old segment at 
the position marked by the adjusted end-point (step 8060 continued). 

15 Figure 8E illustrates object 8030 projected onto image plane 1 10 such that object 8030 

only partially occludes object 8010. Accordingly, renderer 23 reduces the visibility of object 
8010 along line sample 8020 but does not eliminate it. Note that end-point coordinate t,, 
which is associated with object 8010, is in a new position in Figure 8E to reflect the 
adjustment described with reference to step 8060. 

20 Renderer 23 then determines if the new segment overlaps another old segment (step 

8070). If so (step 8070-Yes), renderer 23 returns to step 8028, which is described above. If 
not (step 8070-No), renderer 23 stores in memory 20 information related to the portions of the 
new segment (e.g., end-point coordinates, transparency value, color value), if any, for which 
there is no overlap with an older segment in memory 20 (step 8080). Renderer 23 then 

25 returns to step 1030 to project another object onto image plane 1 10. 

In another aspect of the present invention, renderer 23 updates a number of z-far 
values while processing objects projected onto image plane 1 10. More specifically, renderer 
23 scans the isolated segments to determine the maximum distance of an object from image 
plane 1 10 that is associated with a segment of a line sample. Renderer 23 uses this value to 
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update the z-far values associated with the line sample and various regions that include the 
line sample (e.g., sub-pixel, pixel, or image plane). 

In preferred embodiments, however, renderer 23 adjusts the z-far value only if there is 
a valid association between substantially all of the line sample and one or more objects. 
5 Portions of a line sample that do not have an association with a segment lack a valid 

association with an object. In other words, these portions of a line sample do not overlap an 
object. Portions of a line sample that do not have an association with a segment that is 
consistent with adjacent segments also lack a valid association with an object. For example, 
if two segments are both associated with a first object and border a third segment, which is 

10 associated with a second object that is further away from image plane 1 10 than the first 

object, the third segment is possibly inconsistent. The third segment would be inconsistent if 
for example the first object has holes that allow an object behind it to be viewed. Renderer 
23 determines whether this is the case by an examination of object scene data 21. Invalid 
associations with an object typically occur as a result of errors in object scene data 21 or the 

15 processing of object scene data 21 result in irregularities in the object scene. For example, a 
grid of micropolygons created to represent an object might have gaps between grid cells that 
are not representative of the object. As a result, small regions of a line sample might not be 
validly associated with an object. Accordingly, in preferred embodiments of the invention, 
renderer 23 adjusts the z-far value only if there is a valid association between substantially all 

20 of the line sample and one or more objects. 

As noted above, renderer 23 stores transparent objects that a current line sample 
overlaps in memory 20. After renderer 23 projects all objects within a region of the current 
line sample onto image plane 1 10, renderer 23 processes the segments included in the 
transparency list and the segments associated with opaque objects visible along the current 
25 line sample. The processing includes sorting the segments included in the transparency list 
according to their z-depth values, isolating unique combinations of segments along the 
current line sample, and computing a color for each unique combination. 

In alternative embodiments, renderer 23 processes transparent objects as renderer 23 
projects them onto image plane 110. Thus, in these embodiments, renderer 23 continually 
30 eliminates or sorts transparent objects and portions of transparent objects as described above. 
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Thus, these embodiments do not require the sorting step described below at this point in the 
process. 

Attention now turns to a more detailed description of an embodiment of this aspect of 
the invention. In a first processing step, renderer 23 populates a priority queue with the end- 
5 point coordinates (i.e., t coordinates) of segments associated with the current line sample 

(step 9010, Figure 9A). The priority queue exists in memory 20 and comprises, for example, 
a linked list or an array. As noted above, the t coordinates indicate a distance from an end of 
a line sample. Renderer 23 preferably includes identifiers of the segments associated with 
each t coordinate in the priority queue since a plurality of segments can share a t coordinate. 
10 Furthermore, renderer 23 preferably sorts the priority queue by t coordinate value. Figure 9B 
illustrates, among other things, the end-point coordinates of segments that a line sample 
overlaps (i.e., tO - 16). 

Renderer 23 then determines and lists segments that share the first t coordinate in the 
priority queue (step 9020). The first t coordinate is the lowest value of t at which a segment 

15 overlaps the current line sample. Renderer 23 accomplishes this step by examining the 

priority queue, which as noted above maintains segment identifiers in association with each t 
coordinate. Each segment identified at the first t coordinate is an active segment, which 
means that the segment overlaps a portion of the line sample identified by the first t 
coordinate. In the example illustrated in Figure 9B, only segment 9000 is present at the first t 

20 coordinate, which tO marks. 

If there are active segments for the current t coordinate (step 9025-Yes), renderer 23 
sorts the active segments according to z-depth (step 9040). Thus, renderer 23 determines 
which segments are closest to the current line sample and image plane 1 10. 

Renderer 23 then searches along each active segment for intersections with other 
25 segments (step 9050). As illustrated in Figure 9B, segment 9000 intersects with segment 

9010. Renderer 23 therefore inserts a t coordinate marking the intersection into the priority 
queue (step 9060). Figure 9B illustrates this t coordinate as t3. Because renderer 23 detects 
an intersection, renderer 23 preferably determines whether the intersection affects the 
visibility of the intersecting objects. In the example illustrated in Figure 9B, segment 9010 is 
30 transparent, but segment 9000 is opaque. According, the portion of segment 9010 between t2 
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and t3 is not visible. Accordingly, Tenderer 23 removes t coordinate t2 from the priority 
queue (step 9060). Figure 9C illustrates this example after adjusting the priority queue as 
described above. In this example, therefore, only segment 9000 is active between tO and tl 
even though the current line sample overlaps a portion of segment 9010 over part of this 
5 range. 

Renderer 23 then computes a color with standard computer graphics compositing 
formulas for the active segments along the line sample between the first t coordinate and the 
second t coordinate value in the priority queue (step 9070). Renderer 23 maintains the color 
value in memory 20 along with information such as the values of the first and second t 
10 coordinates. 

Renderer 23 then updates the priority queue and active segments (step 9080). Part of 
this step includes removing the first t coordinate from the priority queue. Accordingly, 
renderer 23 creates a 'new' first t coordinate. Figure 9D illustrates the example illustrated in 
Figure 9C after adjusting the priority queue as described. 

15 Additionally, renderer 23 updates the active segments. As noted above, end-point 

coordinates of segments are added to the priority queue. Accordingly, the second t coordinate 
in the priority queue is often an end-point coordinate of a segment marking the end (as 
opposed to the beginning) of the segment. Since the segment has no further affect on the 
color of the line sample, it is no longer active. 

20 Further, the second t coordinate is often an end-point coordinate of a segment marking 

the beginning of the segment. Thus, this segment is now an active segment if visible from 
image plane 1 10. 

Similarly, the second t coordinate can mark an intersection between two segments. 
Because some or all of the segments are possibly transparent, both segments are often visible 
25 before and after the intersection. However, the ordering of transparent segments does affect 
color values, so renderer 23 does separately compute a color value for two transparent objects 
before and after an intersection between the two. Additionally, one of the intersecting 
segment is not visible before or after an intersection. Renderer 23 therefore separately 
computes a color value before and after the intersection between the two segments. 
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In the example illustrated in Figure 9D, only segment 9000 is visible before and after 
the intersection with segment 9010, so it remains an active segment. Segment 9010 is, 
however, visible only after the intersection with segment 9000. Accordingly, segment 9010 
becomes active. 

5 Renderer 23 then returns to step 9025 to determine whether there is an active segment 

to process. In the example illustrated in Figure 9D, segment 9000 and segment 9010 are 
active (step 9025-Yes), so renderer 23 proceeds to step 9040. 

If there are no active segments to process (step 9025-No), renderer 23 determines 
whether there are additional t coordinates in the priority queue (step 9030). If not (step 9030- 
10 No), render 23 combines the color value of each cross section of segments to determine a 

color value for the line sample. Preferably, renderer 23 weights the contribution of each cross 
section to the final color value of the line sample by reference to the length of each cross 
section. 

If there are additional t coordinates in the priority queue (step 9030- Yes), renderer 23 
15 updates the priority queue and active segment list (step 9080). In this case, there is a portion 
of the current line sample with which no segment is associated. It is possible that certain 
portions of the image scene lack definition (i.e., objects). Additionally, this is possibly a 
result of an error in the processing of the object scene data 21. 

In some embodiments, renderer 23 updates the priority queue by removing the current 
20 first t coordinate, thereby creating a new t coordinate. Renderer 23 also determines which 
segments, if any, are now active. Renderer 23 then returns to step 9025. Thus in these 
embodiments, renderer 23 ignores the portions of the line sample that lack an active segment. 
Further, these portions of the line sample are not a factor in the calculation of a color value 
for the line sample. 

25 In other embodiments, renderer 23 takes certain steps to eliminate these portions 

before computing the color of the line sample as described above. As described above, some 
portions of a line sample lack a valid association with an object. In other words, renderer 23 
did not define a segment for these portions of the line sample. Again, these portions are often 
the result of processing errors. In such cases, renderer 23 preferably extends the segments 

30 bordering such a portion of the line sample to create two new segments. 
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Figure 9E illustrates a portion of the line sample that lacks a valid association with an 
object. Consistent with the process described above, t coordinates mark a beginning and an 
end of a segment. Specifically, tO marks the end of segment 9020 and tl marks the beginning 
of segment 9030. 

5 Figure 9F illustrates segment 9040 and segment 9050 inserted by renderer 23. 

Renderer 23 extends the values of segment 9020 to a position between segment 9020 and 
9030, which tl marks as illustrated in Figure 9F. Thus, segment 9040 maintains the z-depth, 
color, and transparency values of segment 9020 at a position marked by tO between tO and tl. 
Similarly, segment 9050 maintains the z-depth, color, and transparency values of segment 
10 9020 at a position marked by t2 between tl and t2. As indicated above, renderer 23 also 

added t coordinate tl, which marks the intersection of segment 9040 and segment 9050, to the 
priority queue as illustrated in Figure 9F. 

In this particular embodiment, renderer 23 does not maintain the trajectory of segment 
9030; however, some embodiments of the invention do so. Additionally, in other 
15 embodiments, renderer 23 does not extend the two segments to a central point in the invalid 
portion. For example, in some embodiments, one of the end-point properties of one of the 
adjacent segments is randomly selected and extended across the entire invalid portion. 

After adjusting the priority queue and inserting segments as needed, renderer 23 
returns to step 9025. 

20 After computing a color value for a number of line samples, renderer 23 combines the 

color values of the line samples to produce a color value for a pixel (step 1050). In some 
embodiments, renderer 23 uses only those line samples distributed within a given pixel to 
compute a color value for that pixel. In preferred embodiments, however, renderer 23 uses 
line samples distributed outside the boundary of a given pixel to compute a color value for 

25 that pixel. For example, renderer 23 might also use line samples distributed within pixels 
bordering a given pixel to compute a color value for that pixel. In these embodiments, 
renderer 23 preferably weights the contribution of each line sample to the computation of a 
color value according to each line sample's distance from the center of the pixel for which 
renderer 23 is computing a color value. 
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As described above, some embodiments of the invention distribute line samples by 
selecting an orientation and translation amount by reference to a non-regular sequence of 
numbers. In these embodiments, smaller regions of sub-pixels or pixels are over sampled. 
This means that there is an overabundance of relatively short line samples. To minimize the 
effect of such an overabundance of relatively short line samples, the contribution of each line 
sample is weighted according to a length of the line sample. 

In embodiments that distribute line samples by selecting an orientation and area by 
reference to a non-regular sequence of numbers, the contribution of a line sample to the color 
of a pixel is not weighted according to its length. As described above, there is not an 
overabundance of short line samples in these embodiments. 

In alternative embodiments, Tenderer 23 uses an image function to define a color value 
for points across image plane 110. The function permits renderer 23 to determine a color 
value for each point from the line samples through interpolation or extrapolation. Thus, in 
these embodiments, renderer 23 does not combine the line samples per se. Instead, renderer 
23 uses the set of line samples to predict a color value at a set of points on the image plane. 
Renderer 23 then combines the set of points to compute a color value for each pixel. 

After computing a color value for each pixel, an image frame or view of an object 
scene is complete. 

The present invention can be implemented as a computer program product that 
includes a computer program mechanism embedded in a computer readable storage medium. 
For instance, the computer program product could contain the program modules shown in 
Figure 1 A. These program modules may be stored on a CD-ROM, magnetic disk storage 
product, or any other computer readable data or program storage product. The software 
modules in the computer program product may also be distributed electronically, via the 
Internet or otherwise, by transmission of a computer data signal (in which the software 
modules are embedded) on a carrier wave. 

While the present invention has been described with reference to a few specific 
embodiments, the description is illustrative of the invention and is not to be construed as 
limiting the invention. Various modifications may occur to those skilled in the art without 
departing from the true spirit and scope of the invention as defined by the appended claims. 
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For example, in some embodiments, Tenderer 23 computes the view of an object scene along 
only a selected portion of each line sample. In these embodiments, renderer 23 preferably 
uses a non-regular sequence of numbers to select the size and location of a portion of a line 
sample. Additionally, in some embodiments, renderer 23 subdivides a pixel to form a 
5 plurality of sub-pixels, but places a line sample in only a subset of the sub-pixels. In these 
embodiments, renderer 23 preferably uses a non-regular sequence of numbers to select the 
sub-pixels that form the subset. 
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1 1. A method of forming a view of an object scene, comprising: 

2 distributing a set of line samples across an object scene such that the distribution of 

3 the set of line samples is non-regular; 

4 computing a view of the object scene along each line sample in the set of line 

5 samples; and 

6 combining the view of object scene along each line sample in the set of line samples 

7 to form a view of the object scene. 

1 2. The method of claim 1, further comprising transforming an object in the object scene 

2 from a three-dimensional representation to a two-dimensional representation. 

1 3. The method of claim 2, wherein the distributing step includes 

2 projecting objects in the object scene onto an image plane; and 

3 positioning the set of line samples on the image plane. 

1 4. The method of claim 1, wherein the distributing step comprises: 

2 selecting an orientation for a line sample from the set of line samples; and 

3 choosing a plane for the line sample, 

4 whereby the line sample passes through the chosen plane with the selected orientation. 

1 5. The method of claim 4, wherein the orientation is greater than or equal to zero-degrees 

2 and less than one hundred and eighty-degrees. 

1 6. The method of claim 4, wherein the orientation is selected by reference to a low 

2 discrepancy sequence of numbers. 

1 7. The method of claim 4, wherein the orientation is selected by reference to a pseudo- 

2 random sequence of numbers. 
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1 8. The method of claim 4, wherein the plane passes through a central position within a 

2 region of the object scene. 

1 9. The method of claim 4, wherein the choosing step comprises 

2 selecting a translation amount; and 

3 translating the line sample by reference to the translation amount. 

1 10. The method of claim 9, wherein the line sample is confined to an area of the object 

2 scene and the line sample is translated from a position on a perimeter of the area. 

1 11. The method of claim 10, wherein the position is an origin of the area. 

1 12. The method of claim 11, wherein the origin is selected by reference to the orientation. 

1 13. The method of claim 9, wherein the translation amount is limited to a translation 

2 range, said translation range being a function of the orientation and a size of the area. 

1 14. The method of claim 13, wherein the translation range is equal to h X cos(0) , 

2 where h is a maximum distance across the area, and 

3 where 0 is derived from the orientation. 

1 15. The method of claim 14, wherein the maximum distance is not greater 

2 than x 2 + y 2 , 

3 where x is a width of the area, and 

4 where y is a height of the area. 

1 16. The method of claim 14, wherein 6 is equal to the orientation adjusted by 45-degrees. 

1 17. The method of claim 14, wherein Q is equal to the orientation adjusted by 135- 

2 degrees. 

1 18. The method of claim 1, wherein the distributing step comprises 
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2 selecting for each line sample an area defined by an intersection of the line sample and 

3 a region of the object scene within which each line sample is positioned; and 

4 controlling the selecting step so that a selection of the area from a range of possible 

5 areas is substantially uniform. 

1 19. The method of claim 4, wherein the choosing step comprises 

2 selecting an area; and 

3 positioning the line sample within a region of the object scene such that the area is 

4 formed within the region by an intersection of the line sample and the region, 

5 whereby the plane is chosen. 

1 20. The method of claim 19, wherein the positioning step includes translating the line 

2 sample by a translation amount derived from the area. 

1 21. The method of claim 20, wherein the line sample is translated from a position on the 

2 perimeter of the region. 

1 22. The method of claim 21, wherein the position is an origin of the region. 

1 23. The method of claim 22, wherein the origin is selected by reference to the orientation. 

V2 x s x area 

1 24. The method of claim 20, wherein the translation amount is / , , 

VI + s 2 

2 where s is a function of the orientation, and 

s 

3 area is greater than or equal to zero and less than — . 

1 25. The method of claim 24, the function of the orientation is thecot(0) , 

2 where 6 is derived from the orientation. 

1 26. The method of claim 25, wherein Q is equal to the orientation adjusted by 90-degrees. 

1 27. The method of claim 25, wherein 0 is equal to the orientation adjusted by 180- 
degrees. 
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{area + —) 

1 28. The method of claim 20, wherein the translation amount is ; — , 

VI + s 2 

2 where s is a function of the orientation, and 

s s 

3 where area is greater than or equal to — and less than 1- — . 

1 29. The method of claim 28, the function of the orientation is thecot(0) , 

2 where 0 is derived from the orientation. 

1 30. The method of claim 29, wherein Q is equal to the orientation adjusted by 90-degrees. 

1 31. The method of claim 29, wherein Q is equal to the orientation adjusted by 180- 

2 degrees. 

s + 1 - ^2 5(1 - area) 

1 32. The method of claim 21, wherein the translation amount is / : , 

vi + r 

2 where s is a function of the orientation, and 

s 

3 area is greater than or equal tol-— and less than I. 

1 33. The method of claim 32, the function of the orientation is thecot(#) , 

2 where Q is derived from the orientation. 

1 34. The method of claim 33, wherein Q is equal to the orientation adjusted by 90-degrees. 

1 35. The method of claim 33, wherein Q is equal to the orientation adjusted by 180- 

2 degrees. 

1 36. The method of claim 4, wherein the plane is selected by reference to a low 

2 discrepancy sequence of numbers. 

1 37. The method of claim 4, wherein the plane is selected by reference to a pseudorandom 

2 sequence of numbers. 
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1 38. The method of claim 1, wherein the distributing step includes 

2 defining a plurality of sub-ranges of line sample positions from a range of line sample 

3 positions; 

4 selecting a line sample position from each of the plurality of sub-ranges of line sample 

5 positions; and 

6 positioning a line sample by reference to the selected line sample position. 

1 39. The method of claim 38, wherein the line sample position is selected by reference to a 

2 non-regular sequence of numbers. 

1 40. The method of claim 39, further comprising 

2 assigning the line sample position to a line sample in an area of the object scene. 

1 41. The method of claim 40, wherein the line sample to which the line position is assigned 

2 is selected by reference to a non-regular sequence of numbers. 

1 42. The method of claim 1, wherein the distributing step comprises: 

2 positioning a first line sample on the object scene; 

3 distributing candidate line samples across the object scene; 

4 scoring the candidate line samples by reference to the first line sample; and 

5 selecting from the candidate line samples a second line sample by reference to a result 

6 of the scoring step. 

1 43. The method of claim 42, wherein the scoring step comprises an orientation 

2 comparison such that an orientation of the first line sample is compared to an orientation of a 

3 line sample from the candidate line samples. 

1 44. The method of claim 43, wherein the comparison includes determining a difference 

2 between the orientation of the first line sample and the orientation of the line sample from the 

3 candidate line samples. 
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45. The method of claim 44, wherein the comparison further includes normalizing the 
difference, such that a number within a range of zero to one is produced. 



1 46. The method of claim 45, wherein the normalizing step includes dividing the difference 

2 by one-half of a maximum orientation. 

1 47. The method of claim 43, wherein a result of the orientation comparison is weighted to 

2 adjust a contribution of the orientation comparison to a result of the scoring step. 

1 48. The method of claim 42, wherein the scoring step comprises a distance determination 

2 such that a distance between the first line sample and a line sample from the candidate line 

3 samples is determined. 

1 49. The method of claim 48, wherein the distance is calculated by reference to a mid-way 

2 point on the first line sample and a mid-way point on the line sample from the candidate line 

3 samples. 

1 50. The method of claim 48, wherein the distance is calculated by reference to a position 

2 in a region of the object scene in which the first line sample is positioned and a position in a 

3 second region of the object scene in which the line sample from the candidate line samples is 

4 distributed. 

1 51. The method of claim 48, wherein the distance determination includes normalizing the 

2 distance, such that a number within a range of zero to one is produced. 

1 52. The method of claim 51, wherein the normalizing step includes dividing the difference 

2 by a maximum value of the distance. 

1 53. The method of claim 48, wherein a result of the distance determination is weighted to 

2 adjust a contribution of the distance determination to a result of the scoring step. 
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1 54. The method of claim 51, wherein a score of each line sample is equal to 
angle , distance 

90 maximum 

3 where angle is a minimum angle between the first line sample and a line sample from 

4 the candidate line samples, 

5 where distance is a distance between the first line sample and the line sample from the 

6 candidate line samples; 

7 where maximum is a maximum value of the distance between the first line sample and 

8 the line sample from the candidate line samples; 

angle 

9 where a is a factor that adjusts a contribution of ( — — — ) to the score; and 

distance 

where b is a factor that adjusts a contribution of ( ) to the score. 

maximum 

1 55. The method of claim 1, wherein the computing step comprises: 

2 isolating a segment of the line sample that overlaps an object; and 

3 calculating a distance of the object from the segment. 

1 56. The method of claim 55, wherein the isolating step includes calculating a distance 

2 between a first end of the line sample and a transition on the line sample from not 

3 overlapping the object to overlapping the object, wherein a first end-point coordinate of the 

4 segment is derived from the distance. 

1 57. The method of claim 55, wherein the isolating step includes calculating a distance 

2 between the first end of the line sample and a transition on the line sample from overlapping 

3 the object to not overlapping the object, wherein a second end-point coordinate of the 

4 segment is derived from the distance. 

1 58. The method of claim 55, wherein a first end-point coordinate of the segment is set to 

2 zero if a first end of the line sample overlaps the object. 

1 59. The method of claim 55, wherein a second end-point coordinate of the segment is set 

2 to a length of the line sample if a second end of the line sample overlaps the object. 
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60. The method of claim 55, further comprising maintaining object data in relation to the 
segment. 



i 61. The method of claim 60, wherein said object data includes a color value of the object. 

1 62. The method of claim 60, wherein said object data includes the distance of the object 

2 from the object scene. 

1 63. The method of claim 60, wherein said object data includes a transparency value of the 

2 object. 

1 64. The method of claim 55, wherein the distance is calculated from a first end of the 

2 segment. 

1 65. The method of claim 64, further comprising calculating a second distance of the 

2 object from the segment, wherein the second distance is calculated from a second end of the 

3 segment. 

1 66. The method of claim 55, further comprising identifying an overlap between a new 

2 segment and an old segment, said old segment having been isolated before said new segment. 

1 67. The method of claim 66, wherein said identifying step includes a comparison of a set 

2 of end-point values for the new segment and the old segment. 

1 68. The method of claim 67, wherein the new segment and the old segment overlap if a 

2 first end-point of the new segment is closer to a first end of the line segment than a first end- 

3 point of the old segment and the first end-point of the new segment is further away from the 

4 first end of the line segment than the first end-point of the old segment. 

1 69. The method of claim 67, wherein the new segment and the old segment overlap if a 

2 first end-point of the old segment is closer to a first end of the line segment than a first end- 
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point of the new segment and a second end-point of the old segment is further away from the 
first end of the line segment than the first end-point of the new segment. 



1 70. The method of claim 66, further comprising determining if the new object is closer to 

2 the object scene than the old object along the overlap. 

1 71. The method of claim 70, further comprising adjusting the old segment to reflect the 

2 overlap. 

1 72. The method of claim 71, wherein the adjusting step includes removing from the old 

2 segment a portion of the old segment included in the overlap. 

1 73. The method of claim 71, wherein the adjusting step includes modifying an end-point 

2 of the old segment such that the overlap is eliminated. 

1 74. The method of claim 71, wherein the old segment is shortened by a length of the 

2 overlap. 

1 75. The method of claim 71, wherein the adjusting step includes calculating a second 

2 distance of the old object from the segment, wherein the second distance is calculated from a 

3 new end-point coordinate resulting from the adjusting step. 

1 76. The method of claim 55, further comprising setting a maximum distance value 

2 associated with the line sample to the distance of the object from the segment. 

1 77. The method of claim 76, further comprising resetting the maximum distance value 

2 associated with the line sample when an old segment associated with the maximum distance 

3 is overlapped by a new segment such that the object associated with the new segment is 

4 closer to the line sample along the overlap. 

1 78. The method of claim 77, wherein the maximum distance value is reset to a distance of 

2 the object associated with the new segment from the object scene. 
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1 79. The method of claim 55, further comprising setting a maximum distance value 

2 associated with an area of the object scene including the line sample to the distance of the 

3 object from the segment. 

1 80, The method of claim 79, wherein the region of the object scene comprises one or 

2 more sub-pixels. 

1 81 . The method of claim 79, wherein the region of the object scene comprises one or 

2 more pixels. 

1 82. The method of claim 55, further comprising setting a maximum distance value 

2 associated with the line sample to the distance of the object from the segment. 



1 83. The method of claim 55, further comprising 

2 identifying a portion of the line sample overlapping a set of objects; and 

3 computing a color value for the portion by reference to the set of objects, 

4 whereby a color value for a line sample is calculated. 

1 84. The method of claim 83, wherein the set of objects include a transparent object. 

1 85. The method of claim 83, wherein the set of objects includes an opaque object. 

1 86. The method of claim 83, wherein the set of objects includes one or more objects. 



1 87. The method of claim 83, wherein the computing step includes sorting the segments 

2 that comprise the set of objects by reference to a distance from the line sample. 

1 88. The method of claim 83, wherein the identifying step includes 

2 ascertaining a first position on the line sample that marks a beginning of an overlap of 

3 one or more objects by the line sample; 
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4 locating a second position on the line sample that marks an event affecting the 

5 computing step; and 

6 designating the portion of the one or more objects that the line sample overlaps 

7 between the first and second position as a set of objects. 

1 89. The method of claim 88, wherein the event marks an end of an overlap of one or more 

2 objects by the line sample. 

1 90. The method of claim 88, wherein the event marks a beginning of an overlap of one or 

2 more objects by the line sample. 

1 91. The method of claim 88, wherein the event marks an intersection between one or more 

2 objects that the line sample overlaps. 

1 92. The method of claim 83, further comprising computing a color value for the line 

2 sample by reference to a color value computed for one or more said sets of objects. 

1 93. The method of claim 83, wherein a contribution of a set of objects to the color value 

2 for the line sample is a function of a length of the portion of the line sample overlapping the 

3 set of objects. 

1 94. The method of claim 55, further comprising 

2 selecting a number of positions along the line sample; 

3 computing a color value by reference to one or more objects the line sample overlaps 

4 at the number of positions; and 

5 combining the color value computed for each of the positions along the line sample, 

6 whereby a color value for a line sample is calculated. 

1 95. The method of claim 1, wherein the combining step comprises 

2 selecting a subset of line samples from the set of line samples; and 

3 computing a color value for the subset of line samples. 
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1 96. The method of claim 95, wherein the color value is assigned to a pixel. 



1 97. The method of claim 95, wherein the subset of lines samples is distributed within a 

2 region of the object scene. 

1 98. The method of claim 97, wherein the region comprises a pixel. 

1 99. The method of claim 97, wherein the region comprises a set of pixels. 

1 100. The method of claim 95, wherein the computing step includes assigning a weight to a 

2 line sample in the subset of line samples, said weight affecting a contribution of the line 

3 sample to the color value. 

1 101. The method of claim 100, wherein the weight is a function of a distance of a line 

2 sample from a position on the object scene. 

1 102. The method of claim 95, wherein the position is a center of a pixel. 

1 103. The method of claim 100, wherein the weight of a line sample is a function of a length 

2 of the line sample. 

1 104. The method of claim 103, wherein the length of the line sample is determined by 

2 reference to a portion of the line sample for which a color value is defined. 

1 105. The method of claim 103, wherein the weight is reduced by an amount proportional to 

2 an amount by which the line sample is shorter than a maximum line sample length. 

1 106. The method of claim 105, wherein the maximum line sample length is a maximum 

2 distance across a pixel. 

1 107. The method of claim 1, wherein the combining step includes 
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2 selecting a set of points across the object scene such that the points form a regular 

3 pattern; and 

4 interpolating the view of objects in an object scene along each line sample in the set of 

5 line samples at each point in the set of points. 

1 108. The method of claim 1, wherein the combining step includes 

2 selecting a set of points across the object scene such that the points form a regular 

3 pattern; and 

4 extrapolating the view of objects in an object scene along each line sample in the set 

5 of line samples to each point in the set of points. 

1 109. A method of sampling an object scene, comprising: 

2 subdividing an object scene to form a grid; 

3 positioning a line sample in each cell of the grid, wherein the line sample is positioned 

4 by 

5 orienting the line sample by reference to a non-regular sequence of numbers; 

6 translating the line sample within the cell such that an intersection of the line 

7 sample and the grid form an area; and 

8 determining the object scene along the line sample in each cell of the grid. 

1 1 10. The method of claim 109, wherein the translating step comprises 

2 selecting the area formed by the intersection of the line sample and the grid by 

3 reference to a non-regular sequence of numbers; and 

4 deriving a translation amount from the selected area. 

1 111. The method of claim 109, wherein the translating step comprises 

2 determining a maximum translation amount, the maximum translation amount a 

3 function of the orienting step; and 

4 selecting a translation amount within the maximum translation amount by reference to 

5 a non-regular sequence of numbers. 

1 112. A method of sampling object scene data, comprising: 
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2 distributing a set of line samples across an image plane such that the distribution of 

3 the line samples is non-regular; 

4 projecting objects defined in object scene data onto the image plane; 

5 computing a view of objects each line sample in the set of line samples overlaps; and 

6 combining the view of objects each line sample overlaps. 

1 113. A method of defining an array of pixels from object scene data, comprising: 

2 distributing a set of line samples across the array of pixels in a non-regular pattern; 

3 computing a view of an object scene overlapped by each line sample in the set of line 

4 samples; and 

5 combining the view of the object scene overlapped by a subset of line samples from 

6 the set of line samples for each pixel in the array of pixels. 

1 114. A method of forming a video image frame, wherein characteristic information of each 

2 pixel is determined by line sampling object scene data, wherein a line sample is positioned 

3 within a boundary of each pixel in a non-regular pattern. 

1 115. A method of forming a video image frame that specifies characteristic information of 

2 each pixel of an array of pixels that forms the video image frame, wherein the characteristic 

3 information of each pixel is determined by line sampling object scene data, wherein the 

4 object scene data includes information about changes in an object scene that occur during a 

5 time period of the video image frame, wherein a line sample is positioned within each pixel 

6 and within the time period by reference to a non-regular sequence of numbers, whereby any 

7 motion blur of the object scene is included in the video image frame. 

1 1 16. A method of forming a view of an object scene, comprising 

2 establishing a plurality of characteristics of an optical imaging system including an 

3 aperture size and a focal plane relative to objects in an object scene; 

4 positioning a set of line samples across an object scene; 

5 determining a view of the objects along each line sample in the set of line samples by 

6 reference to the position of an object in the object scene and the plurality of characteristics of 

7 the optical imaging system; and 
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8 combining the view of the object scene along each line sample in the set of line 

9 samples. 

1 1 17. A method of forming a view of an object in an object scene, comprising 

2 positioning a line sample on an image plane by reference to a non-regular sequence of 

3 numbers; 

4 establishing a plurality of characteristics of an optical imaging system including an 

5 aperture size and a focal plane relative to an object in an object scene; 

6 selecting for the line sample a position on the optical imaging system through which 

7 to project the object in the object scene onto the image plane; 

8 transforming the object by reference to the selected position on the optical imaging 

9 system while projecting the object onto the image plane; and 
10 determining a view of the object along the line sample. 

1 118. A method of forming a video image frame that specifies characteristic information of 

2 each pixel of an array of pixels that forms the video image frame; 

3 wherein characteristic information of each pixel is determined by line sampling object 

4 scene data at a position within a boundary of each of said pixels, said position selected by 

5 reference to a non-regular sequence of numbers; and 

6 wherein the characteristic information of each pixel is further determined by point 

7 sampling the object scene data. 

1 119. A method for line sampling image data in a computer system for determining 

2 characteristic information of a pixel, comprising: 

3 defining a plurality of sample areas comprising at least a portion of a pixel; 

4 selecting line sample positions within said areas such that the distribution of line 

5 samples is non-regular; and 

6 combining characteristic information of the line samples in the pixel, thereby to 

7 determine characteristic information of the pixel. 

1 120. A method of forming a video image frame that specifies characteristic information of 

2 each area of an array of areas that form the video image frame, comprising 
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3 defining a plurality of substantially non-overlapping portions within said areas; 

4 positioning a line sample within a non-overlapping portion by reference to a non- 

5 regular sequence of numbers; 

6 sampling object scene data at each line sample in a non-overlapping portion; and 

7 combining object scene data along a set of line samples from each area. 

1 121. A method of forming a video image frame that specifies characteristic information of 

2 each pixel of an array of pixels that forms the video image frame, including 

3 positioning line samples in a non-regular, spatial distribution across the video image 

4 frame; 

5 distributing line samples in a non-regular, temporal distribution within a time period 

6 associated with the video image frame; and 

7 combining object scene data along each line sample to determine characteristic 

8 information of each pixel in the array of pixels. 

1 122. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for subdividing an object scene to form a grid; 

5 instructions for positioning a line sample in each cell of the grid, wherein the line 

6 sample is positioned by 

7 orienting the line sample by reference to a non-regular sequence of numbers; 

8 translating the line sample within a cell of the grid such that an intersection of 

9 the line sample and the grid form an area; and 

10 instructions for determining the object scene along the line sample in each cell of the 

1 1 grid. 

1 123. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for distributing a set of line samples across an image plane such that the 

5 distribution of the line samples is non-regular; 



-58- 



WO 02/097728 PCT/US02/16356 

6 instructions for projecting objects defined in object scene data onto the image plane; 

7 instructions for computing a view of objects each line sample in the set of line 

8 samples overlaps; and 

9 instructions for combining the view of objects each line sample overlaps. 

1 124. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for distributing a set of line samples across an array of pixels in a non- 

5 regular pattern; 

6 instructions for computing a view of an object scene overlapped by each line sample 

7 in the set of line samples; and 

8 instructions for combining the view of the object scene overlapped by a subset of line 

9 samples from the set of line samples for each pixel in the array of pixels. 

1 125. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising 

4 instructions for determining characteristic information of each pixel in an array of pixels by 

5 line sampling object scene data, wherein the instructions position a line sample within a 

6 boundary of each pixel in a non-regular pattern. 

1 126. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising 

4 instructions for line sampling object scene data to determine characteristic information of 

5 each pixel in an array of pixels that forms a video image frame, wherein the object scene data 

6 includes information about changes in an object scene that occur during a time period of the 

7 video image frame, and wherein the instructions position a line sample within each pixel and 

8 within the time period by reference to a non-regular sequence of numbers. 
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1 127. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for establishing a plurality of characteristics of an optical imaging system 

5 including an aperture size and a focal plane relative to objects in an object scene; 

6 instructions for positioning a set of line samples across an object scene; 

7 instructions for determining a view of the objects along each line sample in the set of 

8 line samples by reference to the position of an object in the object scene and the plurality of 

9 characteristics of the optical imaging system; and 

10 instructions for combining the view of the object scene along each line sample in the 

1 1 set of line samples. 

1 128. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for positioning a line sample on an image plane by reference to a non- 

5 regular sequence of numbers; 

6 instructions for establishing a plurality of characteristics of an optical imaging system 

7 including an aperture size and a focal plane relative to an object in an object scene; 

8 instructions for selecting for the line sample a position on the optical imaging system 

9 through which to project the object in the object scene onto the image plane; 

10 instructions for transforming the object by reference to the selected position on the 

1 1 optical imaging system while projecting the object onto the image plane; and 

12 instructions for determining a view of the object along the line sample. 

1 129. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising 

4 instructions for forming a video image frame that specifies characteristic information of each 

5 pixel of an array of pixels that forms the video image frame, wherein the instructions 

6 determine characteristic information of each pixel by line sampling object scene data at a 
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7 position within a boundary of each of said pixels and by point sampling object scene data at a 

8 position within the boundary of each of said pixels. 

1 130. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for defining a plurality of sample areas comprising at least a portion of a 

5 pixel; 

6 instructions for selecting line sample positions within said areas such that the 

7 distribution of line samples is non-regular; and 

8 instructions for combining characteristic information of the line samples in the pixel, 

9 thereby to determine characteristic information of the pixel. 

1 131. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for defining a plurality of substantially non-overlapping portions within 

5 an area of an array of areas that form a video image frame; 

6 instructions for positioning a line sample within a non-overlapping portion by 

7 reference to a non-regular sequence of numbers; 

8 instructions for sampling object scene data at each line sample in a non-overlapping 

9 portion; and 

10 instructions for combining object scene data along a set of line samples from each 

1 1 area. 

1 132. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for positioning line samples in a non-regular, spatial distribution across an 

5 array of pixels that form a video image frame; 

6 instructions for distributing line samples in a non-regular, temporal distribution within 

7 a time period associated with the video image frame; and 
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8 instructions for combining object scene data along each line sample to determine 

9 characteristic information of each pixel in the array of pixels. 

1 133. A computer program product for use in conjunction with a computer system, the 

2 computer program product comprising a computer readable storage medium and a computer 

3 program mechanism embedded therein, the computer program mechanism comprising: 

4 instructions for distributing a set of line samples across an object scene such that the 

5 distribution of the set of line samples is non-regular; 

6 instructions for computing a view of the object scene along each line sample in the set 

7 of line samples; and 

8 instructions for combining the view of the object scene along each line sample in the 

9 set of line samples to form a view of the object scene. 
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